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Clozentropy procedure is a method whereby researchers 
pretest messages to determine their levels of comprehenslbilit y among 
given audience members. It is pften used to measure the English 
language proficiency of foreign students. The procedure utilizes a 
passage of prose from which words are deleted on either a random or 
systematic basis and replaced with blanks. Subjects fill in the 
blanks with what they feel are the words the author used, and their 
responses are compared with those agreed upon by a standard 
criterion. In one experiment the subjects were Filipinos with both 
low*level and high-level education and both low and high degrees of 
familiarity with the subject of the message. The content variables 
were difficulty level and idiosyncrasy level. Results indicated that 
the level of education accounted for more variance in comprehension 
than did the idiosyncrasy level* Results of the study support the 
premise that the clozentropy procedure is a valid and sensitive 
method of measuring communication comprehension. (RN) 
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ARSTRACT 



Two-Culture Validation Study o£ Clozentropy as a Measure of 
Intercultural Connunication Comprehension" 

by 

Pennis T, Lowry and Theodore J, Marr 



The present study was designed to test the validity of Darnell *s 
clozentropy procedure as a measure of coomunication comprehension in 
general and intercultural comnunication comprehension in particular* 
The study investigated two major subject (audience) variables and two 
major content variables. The two subject variables were education level 
and prior fami l iarity level with the specialized (idiosyncratic) content 
with which tho subjects were presented. The two content variables were 
difficulty lev el and idiosyncrasy level . 

Four SOO-word passages were purposively selected because of the 
known characteristics they contained. Likewise > four groups of Filipino 
Ss with kiftown group characteristics were recruited. The criterion group 
consisted of American Ss with known group characteristics, 

Tnn a priori hypotheses concerning intercultural communication 
comprehension were tested using multiple linear regression. All ten 
hypotheses were supported by the data- --at p value levels ranging from 
,0000008 to ,0000001, 

The results of the study strongly supported the position that the 
clozentropy procedure is both a sensitive and a valid measure of communi- 
cation coD^>rehen8ion, 



It 18 axiomatic that for an individual to be able to conmunicate 
hia Intended meaning to a second Individual there must be some degree 
of similarity in the way the two individuals use and understand signs. 
In the case of verbal coa0unication> there must be some degree of simi- 
larity in the way the two individuals use a given verbal system of 
signs. 

For example » a letter written in Mandarin Chinese will commimi- 
cate zero intended meaning to an English-speaking American who has 
never before even seen written Mandarin. An English'-speaking American 
who has taken a one -year course in Mandarin might be able to understand 
a good portion of the intended meaning In the letter. An English-speaking 
American who also happens to be fluent in Martdarln would probably under- 
stand the vast majority of the intended meaning. 

Thus I communication coaq[>rehension is related to (among other 
things) the degree of similarity In the way Individuals use and under- 
stand a given language. If there iis no similarity the^e will be no 
comprehension. If there is a great deal of similarity there may be a 
high level of comprehension. 



The Mandarin/English example Is an extreme cana. However » the 
poeition taken in this paper is that the same principle applies oh a 
reduced scale to the way different cultural groups or gub-*groups (e.g 
Aaiericans and English-speaking Filipinos) use the same lanituaae (e.g. 
English). Furthermore* this paper investigates the relationships 
between a specialized form of English (containing religious Jargon) » 
prior familiarity with this specialized form> and comnunication com- 
prehension* 

Clozentropy Theory and Method 

The term **clozentropy** was coined by Darnell^ to indicate a 
2 

merging of Taylor* s cloze procedure and an entropy measure derived 
from Shannon and Weaver's information theory* Darnell's goal in 
developing clozentropy was to build an improved test to measure the 
English langt&age proficiency of foreign students* Some of his assump 
tions were: 

1* The primary function of language is coanunication* 

2* This function is best served within any group by co^>liance 

with the group norms of language usage* 
3* A measure of proficiency in language should index one's 

ability to conform to existing group norms of language 

rather than to some prescriptive model or idealized language 

pattern* 

4* If language norms vary from group to group, the best measure 
of proficiency for an individual is in terms of the group or 
groups with whom h^ needs to communicate* 

As developed by Taylor, the basic cloze procedure consists of 
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deleting words on either a random or a systematic basis from the test 
passage of prose^ The deleted words are replaced with underlined 
blanks of identical size. Administration of a cloze test of this kind 
is easy. Subjects are simply given the passage and asked to fill in 
the word they think best fits the writerU original statement. A sub* 
ject's score is the total "correct" words he fills in the blanks — 
i.e. I thos'd that are identical to the author^s original word choices* 
As Taylor states, the cloze procedure "assumes that (a) the more readable 
a piece of writing is, the.bet^ter understood it will be even if some 
words are left out , and (b) the better the writing is understood* the 
mote likely it is that a reader can guess what words are missing."^ 
Readability and comprehensibility are assumed to be synonymous « The 
scores produced may be summed across passages and/or across subjects, 
depending on the type of design used« 

The scoring procedure used in Darnell's clozentropy procedure is 
different than used in Taylor's cloze procedure — and more complicated. 
Instead of comparing a subject's response against the writer of the 
passage I and scoring it "correct'* or "incorrect", each subject's 
response to a given blank is compared against all of the responses 
placed in the same blank by the members of some criterion group of 
interest who have taken the same test. Thus, a subject's response is 
"correct" to the degree that mambers of the criterion group aRree that 
it is . This follows from the pragmatic view that "good" language usage 
is whatever a defined group agrees it should be** -and whatever is 
functional for group communication* In a word: "Good*^ language usage 
is relative to grt>up consensus. 



V 



Darnell explains the clozentropy scoring procedure as follows: 
Considering the array of re/iponses from some specific group of 
Ss to a particular cloze itemi determine the number of different 
responses and the relative frequency of each one. Taking the 
relative frequency as an estimate of the probability of each 
different response , calculate the ''average surprise value" of 
responses to that Item (H * "^Pj ^^^82 P^^* This value may be 
called the entropy of the blank; it is a measure of the freedom 
of choice available to respondents. Next, calculate the ''surprise 
value" or "information value" of each of the different 
responses (I ^ log^ 1/p) . Obtain the difference (D) between the 
I value for each response and the H value for each blank 
(H - I e D) . Repeat this procedure for each item and sum the 
D scores for each S across all items in the test. The total D 
score is an indication of the extent to which the individual 
tends to give responses that are unusual in the context of the 
group* s responses • • • ."^ 
The present study uses ReiUy's^ simplified scoring procedure: 

Step 1 » Compute for each blank the frequency » n^j, of 
individuals in the criterion group choosing each response and 
record ^og^^ n^y which will be the scoring weight for that 
response. 

Step 2 . For each examinee in the new sample compute 
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where the ^^S^o^ijk weights associated with each responsei 

obtained in Step !• A zero weight is given to new responses 
g 

since 1o8jq1 * 0» 

Reilly*s T score> while coiaputationally slmpleri is perfectly correlated 
with Darnel Ps D score and has the Bame reliability, validity, and 
correlation with other variables. 

As mentioned above, DamelPs goal in developing clozentropy was 
to build an improved test for measuring the English language proficiency 
of foreign students. However » he did not point out in his original 
article that the same methodology and scoring procedures have exceedingly 
important implications for a different but related area of communication 
research. The same clozentropy procedures which can be used to measure 
the English language proficiency of foreign students coming to this 
country can also be used to measure (a) the comprehension level of any 
d efined audience in country X and also (b) the comprehensibility level 
of any defined verbal comnrunication Y for the defined audience in 
question. Furthermore, it will permit a researcher to test the relative 
effectiveness of several coimBunications (Y]^»^2'^3' etc.) to find the 
optimum comprehensibility level for his defined audience in country X. 

The implications of being able to do this are obvious: A communi- 
cator now has a new tool at his disposal to help him measure th^ com^^ 
prehensibility (difficulty) level of his messages — not in a general 
sense I but relative to the specific audience to which he is interested 
in communicating-* *and then to modify his messages as needed to attempt 
to match the comprehension level of his audience. 

If the government of Mexico, for exaiq>le, wanted to inform its 
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people about a new government public health program, one of the things 
it might do would be to prepare an information booklet for free public 
distribution. For purposes of this i)aper» there are two major Ways in 
which the booklet could be ^'off target'' and therefore ineffective* It 
could be written at too high a level of difficulty and/or it could 
contain a specialized form of Jargon unfamiliar to the audience <e*g.| 
medical Jargon or "bureaucratese") • The present writers believe that 
clozentropy research might fruitfully be used in this And numerous related 
situations to pretest messages on a sample of the population before dis* 
seminating them to the entire population. 

In recommending this course of action, the writers begin with 
the following four assumptions (which are somewhat parallel to Darnell's 
assumptions presented above): 

^ . The basic objective of most communicators most of the tiik') 
is to maximize the amount o£ intended meaning that is 
successfully communicated to their audiences* (There are 
timesi of course, when this is not the case--*e.g«i in Some 
political rhetoric.) 

2. This basic objective is best achieved when a communicator 
constructs his message at a level of difficulty which is at 

or below the mean cpmprehension level of his defined audience* 

3. Regardless of difficulty level, this basic objective is 
likewise best achieved when a commiunlcator chooses a form or 
type of communication content which is familiar to his audience. 

4* Since comprehension levels and content familiarity vary from 
group to group, a communicator must (a) measure the compre- 
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hension level of his defined audience, (b) measure the present 
content familiarity o£ his audience, and then (c) construct 
his message(s) accordingly. 
Prom the foregoing introduction to this relatively new comMUnica- 
tion research tooi> closentropyi and from the exas^ples given, it can be 
seen that clozentropy holds great potential in a number of areas 
dealing with communication comprehension* However, like all new research 
tools, clozentropy must undergo a period of rigorous validity and 
reliability testing before it can be widely accepted by the research 
connunity. Very little clozentropy validation research has been pub- 
lished to date. In addition to Darnell *s original article, the present 
authors are aware of only one other published study investigating the 
validity of clozentropy. 

9 

Connelly and Knabe compared the responses of Catholic priests 
(the criterion group) against the responses of a group of laymen on 
two types of content^^^senaon material and soclal^ecological material. 
As hypothesized I there was a significant difference in the way the 
priests and laymen responded to the sermon material. However, the 
study Is complicated by the finding that the priests and laymen also 
responded significantly differently to the social -ecological oiaterial 
«-*>where no difference was expected. Unfortunately, it is Impossible 
to tell from the published article if this unexpected finding is due to 
the heterogenous nature of the group of laymen (drawn from university 
students, the staffs of two hospitals, one Roman <!atholic parish, and 
a Lutheran adult education class), whether the difference is due to a 
possible overall difference In education levels between thit criterion 
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group and the test group, or whether it is due to still other variables* 

The present study ^ which began in the spring of 1971 » is a cloz* 
entropy instrument validation study which attempts to (1) provide a 
much more controlled and rigorous test of the clozentropy procedure 
than did the Connally and Knabe study, and also (2) serve as a demon* 
stration study of how the procedure might be used in '^applied" field 
settings. 

Variables and Hypotheses Used 

This study investigates two major subject (audience) variables 
and two major content variables. The two subject variables are 
education level and prior familiarity level with the specialized 
(idiosyncratic) content with which the subjects were presented. The 
two content variables are difficulty level and idiosyncrasy level . 
Exactly how these variables were operatlonalized vlU be explained 
below. 

Since the subjects were drawn from known groups/ and since the 
communication content presented them had known characteristics* the 
researchers were in a position to hypothesize what the comprehension 
levels *^should'* be if indeed the clozentropy procedure is as valid as 
it is claimed to be. 

Hypothesis 1 ; Comprehension for the Hi Education Ss. should be 
significantly higher than comprehension for the Lo Education Ss* 
Reason: The higher an individual's education level » the higher his 
message decoding and processing skills are likely to be. If the 
clozentropy procedure is valid, this difference in education levels 
of the Sb should be reflected in the comprehension scores. 

ERLC 
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Hypothesis 2 ; Comprehension for the Hi Prior Familiarity Ss 
should b6 significantly higher than comprehension for the Lo Prior 
Faailiarity Ss* Reason: PebpH generally perform better when they are 
familiar with a task than when they are unfamiliar* If the clozentropy 
procedure is valid, this difference in prior familiarity levels of the 
Ss should be reflected in the comprehension scores. 

Hypothesis 3 ; Comprehension on the Lo Difficulty passages should 
be significantly higher than comprehension on the Hi Difficulty passages* 
Reason: Understanding a Lo Difficulty passage is» by definition* an 
easier task than understanding a Hi Difficulty passage. I€ the clos* 
entropy procedure is valid^ this difference in difficulty levels of 
the passages should be reflected in the comprehension scores. 

Hypothesis 4: Comprehension on the Lo Idiosyncrasy passages 
should be significantly higher than on the Hi Idiosyncrasy passages* 
Reason: Lo Idiosyncrasy passages are> by definition » more similar to 
general everyday language usage > and are thus more familiar to the Ss* 
If content familiarity is important to comprehension » and if the cloz- 
entropy procedure is valid i this difference in idiosyncrasy levels of 
the passages should be reflected in the comprehension scores* 

Hypothesis 5 : The multiplicative effect of Education Level X 
Prior Familiarity Level should be positively and significantly related 
to co]^>rehension* Reason: CoiAprehension itself is theorized by the 
writers to be a complex phenomenon equal to more than the sum of its 
parts . Since Education Level and Prior Papiliarity Level are considered 
to be two of the most important intra-subject variables relating to 
comprehensioAj they should produce an interaction effect greater than 
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the sum of their separate effects, If this is sd^ ahd if the cl02* 
entropy procedure is valld» this interaction should be reflected in the 
comprehension scores. 

Hypothesis 6 ; The t&ultiplicative effect of Difficulty Level X 
Idiosyncrasy Level should be positively and significantly related to 
comprehension scores .^^ Reason: Same as for hypothesis 5. 

Hypothesis 7 : The multiplicative effect of Education Level X 
Difficulty Level X Idiosyncrasy Level should be positively and sig- 
nificantly related to comprehension scoiest Reason: Same as for 
hypothesis 5« except this is a three-way interaction. 

Hypothesis 8 ; The multiplicative effect of Prior Familiarity 
Level X Difficulty Level X Idiosyncrasy Level should be positively and 
significantly related to comprehension scores. Reason: Same as for 
hypothesis 5, except this is a three-way interaction. i 

Hypothesis 9 : The multiplicative effect of Education Level X 
Prior Familiarity Level X Difficulty Level X Idiosyncrasy Level should 
be positively and significantly related to comprehension scores. Reason: 
Same as for hypothesis 5, except this is a four-way interaction. 

Hypothesis 10 : The multiplicative effect of Education Level X 
Difficulty Level X Idiosyncrasy Level is significantly greater than 
the multiplicative effect of Prior Familiarity Level X Difficulty 
Level X Idiosyncrasy Level. Reason: Education Level Is theorized as 
being fundamentally more important (when interacting witt\:^)Dlf f Iculty 
Level and Idiosyncrasy Level) to comprehension than 1^ Prior Familiarity Level 
(when also interacting with Difficulty Level and Idiosyncrasy Level)) 
because as a person^s education level increases he is more likely to 
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be able to master the idiosyncrasy problem in addition to the difficulty 
problem. However^ on the contratVi ad his prior familiarity level in« 
creases he is not as likely to master both the difficulty problem and 
the idiosyncrasy problem. 

METHOD 

Four 500«-word passages were purposively selected because of the 
known characteristics the passages contained. A one-page example of 
each of these passages is reproduced as Appendices A through D. 

Passage 1: Lo Diff iculty/Lo Idiosyncrasy — a children's story 

taken from a fourth grade Filipino reader. Flesch reading 

ease score: 94.1 (''very easy"). 

Passage 2: Lo Difficulty/Hi Idiosyncrasy — taken from the New 
Life Testament ) a version of the New Testament written for new 
literates and using a vocabulary of about 800 words. Flesch 
reading ease score: 94.0 ("very easy"). 

Passage 3: Hi Diff iculty/Lo Idiosyncrasy - -"taken from Semantics 
and Communication » a college level monograph. Flesch reading 
ease score: 38.8 ("fairly difficult"). 

P assage 4: Hi Difficulty/Hi Idiosyncrasy — taken from the Kin^ 
James Bible . Flesch reading ease score: 59.6 (^'fairly difficult"). 
The passages were typed triple-spaced with every lOth word deleted and 
replaced with a standard-size underlined blank. Thus, for each passage 
there were 50 blanks. The passages were reproduced and assembled into 
test booklets in a random order to eliminate any possible order effects. 
Likewise, four groups ^f Ss with known group characteristics were 
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selected. 

Group 1: Lo Educatton/Lo Prior Fftmlltattty *-->8tudents from 
Manuel Roxas High School^ a public high school in Manila} 
students who were not known to the test administrator and the 
school guidance counselor to be active in any evangelical 
Protestant student groups and/or churches. Mean age: 15*9. 
Mean years of education: 9.O. (N « 23) 

Group 2: Lo Education/Hi Prior Faniliarity — students fron 
Manuel Roxas High School who were personally known to the test 
administrator and the school guidance counselor to be active 
in evangelical Protestant student groups and/or churches* 
Mean age; 14.24 Mean years of education: 7«9* (N » 25) 
Group 3: Hi Education/Lo Prior Faniliarity ***students from the 
University of the Philippines who were not known to the test 
administrator to be active in any evangelical Protestant student 
groups and/or churches. Mean age: 21*0* Mean years of educa- 
tion: 14.0. (N s 24) 

Group 4: Hi Education/Hi Prior Familiarity *-"Students from the 
University of the Phili||>pines who were members of Inter*Varsity 
Christian Fellowship» an evangelical Protestant student group. 
Mean age: 20*4* Mean years of education: 14*0* (N » 24) 
The criterion group (M a 40) » against which the responses of the 
Filipino Ss were compared^ was defined as Hi Education/Hi Prior Familiarity/ 
American . All criterion group members had at least four years of college, 
and all had been active in evangelical Protestant churches for at least 
a year. 
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Hembere of tlio criterion group and the tost Ss were permitted 
a maxltttua o£ IS minutes to £lll In the SO blanks In each passage. 
Most nembers of the criterion group did not need the full IS ninuteS) 
while some members of the Lo Education test groups were not able to 
insert even guesses in all 50 blanks in 15 minutes. It was the Judgment 
of the test administrator and the researchers that they would not have 
been able to finish even if the time had been doubled. Therefore » the 
IS^minute time limit was adhered to for the sake of test administration 
efficiency » and because their not being able to finish does provide 
some information about their comprehension level. 

Test Ss were paid 3 pesos for their time and to insure a high 
level of motivation. This amount was equivalent to about 46 cents (US>| 
but was worth considerably more than this in terms of buying power, and 
therefore incentive » in the ^^ilippines. Members of the criterion group 
were not paid. Test Ss took th^ tests either individually or in groups 
of varying sizei depending upon whatever arrangements could be made. 

Variant spellings of the same words were cleaned up to bring them 
into agreement (e.g.| armour to armor). The Justification for doing 
this is that two subjects obviously have the same meaning in mindi and 
have 8itq)ly used two different spellings of the same word to express it. 
All data were punched for computer analysis. The clozentropy scoring 
was performed by an original computer program written in PLl by Theodore 
J. Marr. This program provides both printed ^nd punched output of the 
T scores for each subject on each passage. This punched output was 
then used as the data input in ^n hypothesid-*testing multiple linear 
regression program to test the ten hypotheses stated above. 
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RESULTS 

Figure 1 provides an overview o£ the results « As expected^ the 
criterion group had the highest comprehension scores on all four passages » 
This top curve» then^ serves as a ceiling tor the four test groups« In 
other words » they have the potential of going as high as the celling* 
but cannot go higher. In the opposite direction > a zero cookprehension 
score is possible. 

As would be expected » the criterion group and the four test groups 
all had their highest comprehension on the Lo Dif f iculty/Lo Idiosyncrasy 
passage. Then> when they came to the Lo Difficulty/Hi Idiosyncrasy 
passage (which was equivalent to passage 1 in terms of Flesch score) » 
the comprehension scores for all groups dropped* However* it is important 
to note that the drop was not as great for the three Hi Prior Familiarity 
groups as for the two Lo Prior Familiarity groups. 

The same pattern is evident on the two Hi Difficulty passages 
as on the two Lo Difficulty passages* except that all of the comprehension 
scores are lower because the content is more difficult* In moving from 
passage 2 to passage 3> the two Hi Education curves and th9 two Lo 
Education curves converge somewhat. However * in moving from passage 
3 to passage 4* the two Hi Education curves and the two Lo Education 
curves diverge sharply. In both instances they diverge because the 
Hi Prior Familiarity curves go up and the Lo Prior Familiarity curves 
go down. 

As an indication of how important prior familiarity is to coflq[>re- 
hension* it should be noted that on passage 4 the Lo Education/Hi Prior 
Familiarity group (with a mean age of 14«2 and a mean years of education 
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of 7*9) scored hi gher than the HI Education/Lo Prl.or Faailiatity group 
(which had a aean age of 2l»0 and a mean years of education of 1A*0) . 

Each of the variables represented in hypotheses 1 through 9 was 
tested In a linear regression model against the unit vector* The 
following full and restricted ttodels were used: 

Full Model: « a^U + a^X^ + E^ 

Restricted Model: « a^U 4 E^ 

Where: » the criterion variable , comprehension 

U a the unit vector 

Xj^ B the predictor variable being tested 

and E2 » the error tera& for the two models 

a^ and a^ » the least squares Weighting coefficients 
calculated so as to minimize the sum of 
squared values in the error t^drmSi 

Results for Hypothesis 1 : Coisprehenslon for the Hi Education Ss 
should be significantly higher than comprehension for the Lo Education 
S8« As Table 1 indicates » the education variable alone accounted for 
•14 of the variance in comprehension! The F ratio between the full and 
restricted models was 64»14> and the p value was highly significant 
at less than «0000001* Therefore, hypothesis 1 was supported by the data* 

Results for Hypothesis 2 : Comprehension for the Hi Prior Fa'ailiarity 
Ss should be significantly higher than coiq>rehension for the Lo Prior 
Familiarity Ss* Prior Familiarity accounted for .08 of the variance 
in comprehension and produced «n F ratio of 34.93 and a corresponding 
p value of less than .0000001 (See Table 2)* Therefore^ hypathesis 2 
was supported by the data. 

Results for Hypothesis 3 : Comprehension on the Lo Difficulty 
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passages should be significantly higher than coB^rehertsloh on the Hi 
Difficulty passaged* Vhe results in Table 3 show that difficulty level 
alone accounted for ,35 of the variance in comprehension* The F ratio 
was 205«00 and the p value less than •0000001* Therefore^ hypothesis 
3 was supported by the data* 

Results for Hypothesis 4 : Comprehension on the Lo Idiosyncrasy 
passages should be significantly higher than on the Hi Idiosyncrasy 
passages. As reported in Table 4, idiosyncrasy accounted for .06 of 
the variance in comprehension* Tt^e P ratio for this variable was 23* 77 
and the corresponding p value was less than .OOOOOOd* Therefore^ 
hypothesis 4 was supported by the data* 

Results for Hypothesis 5 : The multiplicative effect of Education 
Level X Prior Familiarity Level should be positively and significantly 
related to comprehension* Table 5 presents the results of this statis* 
tical test* Education X Prior Familiarity accounted for .23 of the 
variance in comprehension and produced an F ratio of 112*32* The 
corresponding p value was ^ess than ,0000001* ThereforSi hypothesis 
5 was supported by the data. 

Results for Hypothesis 6 t The nultipUcative effect of Difficulty 
Level X Idiosyncrasy Level should be positively and significantly related 
to comprehension* The data in Table 6 indicate that Difficulty X Idio- 
syncrasy accotinted for *4l of the variance in comprehension » an aaount 
almost double that of Education X Prior Familiarity* The F ratio is 
264*98 and the p value Is less than *0000p01* Therefor6» hypothesis 6 
was supported by the data* 

Results for Hypothesis 7 : The multiplicative effect of Education 
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Level X Difficulty Level X Idipsyncrasy Level should be positively and 
significantly related to comprehension « Table 7 shows that this three* 
way interaction accounted for of the variance in comprehension, 
the F ratio was 130*90 and the corresponding p value was less than 
.0000001. Therefore^ hypothesis 7 was supported by the data. 

Results for Hypothesis 8 : The multiplicative effect of Prior 
Familiarity Level X Difficulty Level X Idiosyncrasy Level should be posi- 
tively and significantly related to comprehension. As Table 8 indicates ^ 
this three-way interaction accounted for .21 of the variance in compre* 
hension and produced an F ratio of 98.85 with a corresponding p value of 
less than .OOOOOOl* Therefore^ hypothesis 8 was supported by the data. 

Results for Hypothesis 9 t The multiplicative effect of Education 
Level X Prior Familiarity Level X Difficulty Level X Idiosyncrasy Level 
should be positively and significantly related to comprehension, table 
9 contains the results of this four-way interaction and shows that .15 
of the variance in comprehension was accounted for. The F ratio was 
67.95 and the corresponding p value was less than .0000001. Therefore* 
hypothesis 9 was supported by the data. 

Results for Hypothesis lO i The multiplicative effect of Education 
Level X Difficulty Level X Idiosyncrasy Level is significantly greater 
than the multiplicative effect of Prior Familiarity Level X Difficulty 
Level X Idiosyncrasy Level. The thrust of this hypothesis is that the i 
three-way interaction effect involving Education L^vel is greater than 
the three-way Interaction effect involving Prior ramlliarity Level, 
the following full and restricted linear regression models were used 
to test this hypothesis: 
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Full Models « a^U + A^X^ + a^X^ + 
Rastrleted Modelt « a^U a^Xg + 
Uharat ^ the criterion variable, comprehension 

U » the unit vector 

X. « Education Level X Difficulty Level X Idiosyncrasy 
^ Level 

X^ » Brlot FanlUarlty Uvel X Difficulty Uvel X 

Idiosyncrasy Level 

and ^ the error terms for the two nodels 

a^> a. I and a^ the least squares weighting coefficients 
calculated so as to alnlalte the sum of 
.equated values In the error terms* 

table 10 shows that the amount of variance accounted for by the full 

model was «33 and the amount of variance accounted for by the restricted 

model was «21. The F ratio was 67. 71 and the corresponding p value was 

less than f0000001« Therefore, hypothesis 10 was supported by the data* 

Discuss lOH AND CONCLUSIOKS 

The tesults of this study strongly support the position that the 
clozentropy procedure Is both a sensitive and a valid measuve of comaunl- 
cation coim>rehens Ion. The data supported all ten hypotheses** •and all 
at highly significant p value levels. The **maln effects** for Education 
Level, Prior Familiarity Level, Difficulty Level, and Idiosyncrasy 
Level were ell significant. 

Ck>^)atlng the two In trA*subj4ct variables > It <ian be seen that 
Education Level accounted tot more varlence In comf^irehenslon than did 
Prior FAmlllatlty Leveli This U shown in the results to hypotheees 
it 2i and 10. When compatiag the results df the two Intra^content 
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variables, It can bo seen that Difficulty Level accounted for more 
variance than did Idiosyncrasy L^vel* The single variable which accounted 
for the most variance when tested against the unit vector was Difficulty 
Level (R » ^SS), and the interaction which accounted for the most vari- 
ance when tested against the unit vector was Difficulty Level X Idio- 
syncrasy Level (R » t41)i 

Some post hoc data analysis indicated that a single linear ra- 
gression model with the four main predictor variables accounted for .64 

of the variance in cooq>rehension« (See Table 11«) Adding two two-way 

2 

interaction variables to the model increased the R to •lU* Adding 

2 

two thre6*-way interaction variables to the model increased the R to 
•76« Thusi it is possible to account for •76 of the variance in com* 
prehension with a single linear regression model containing eight 
variables. 

This study also provides some insight into the compleit interactive 
nature of the intercul tural comnunication comprehension process * As 
reported above I there were significant intra-subject interactions^ 
intra*content intiiractions» and subject/content interactions* The im-^ 
plication of this is that since the process under investigation is so 
conplex, future studies of Intercultural cousunication comprehension 
will have to use theories, research methods » and data analysis techniques 
capable of coping with the complexities inherent in the process^ 

It should be pointed out that the ten hypotheses tested in this 
study in no way exhaust all of the possibly significant questions which 
might have been asked« tn deciding ^ich hypotheses tu> test the authors 
wete guidedi first> by a desire to study the validity of tha eloeentropy 
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procedure in an intercut tural setting and» second, by a desire to test 
soflie possible explanatiohs of the interactive processes underlying cota^ 
prehension* It is hoped that other researchers in the future Vill re- 
test the present hypotheses and go on to test additional ot competing 
hypotheses* 

The results of this study should be of great interest to connuhi* 
cation practitioners who work In intercultural connunication in applied 
settings* The clozentropy procedure does indeed appear to nake it 
possible for the intercultural communicator to do a better job of matching 
his messages to his audience than he ever could before* 

tt goes almost without saying that the entire area of intercultural 
communication comprehension > and the clozentropy procedure In partlcular» 
deserve considerable research attention in the years ahead* First » 
there is a need to study variables other than Education tevel» Prior 
Pamiliatity Level i Oifficulty Level* and Idiosyncrasy Level* The 
present study has demonstrated that these four variables have a major 
influence on comprehensioni but certainly there must be other important 
intra^subject and intra«content variables as well« \ Second^ the cost/ 
payoff efficiency of the clozentropy procedure musttbe compared with 
some of the older, but easier, measures of isessage <ftfficulty^ such 
as the Flesch formula and Dale-Chall formula* The clozentropy procedure 
may be more precise, but is the extra precision vortti the extra costt 
Third, researchers Interested in intercultural comnui: 
ately see the need to test the clozentropy procedure 



icatlon can lamedl«* 
in other cultures I 



in othdr non*Snglish languages i ar^d on othsr typeA o^ co^^tent* 
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TABLE 1 

Education Level es the Predictor VarlabUi Co^>reheasloa «• the Criterion 
variable 

2 ' 
R <1£ F p< 



O.U 1» 382 64.14 .0000001 



TABLE 2 

Prior Faalllarlty Level as the Predictor Variable^ Coaprehanelon aa 
the Criterion Variable 

R d£ P p< 



0.08 1» 382 34.^3 .0000001 



TABU 3 

Difficulty Level ai the Predictor Variable* Conprehenalon ae the 
Cirltcirlon Variable 

-— — — Y*— — — — — — — — -— — - 

R df P 



0.35 1» 382 205.00 .0000001 



TABLE A 

Idloayncrasy Level ea the Predictor Varleble, CMprehentlon es the 
Criterion Variable 

2 

R df F p< 



0.06 1, 382 23.7> .OcloOOOS 



tABLE 5 

Educatiott Level X Prior Familiarity Level ai the Predictor Variable, 
Coovreheiislon Level ai the Criterion Variable 

df F i>< 

0.23 1. 362 112.32 . 0000001 



TABLE 6 

pifficulty Level X Zdioayneraay Level as the Predictor Variable* 
CoBq>rehen8ion Level as the Criterion Variable 

m:-'' " ■ r ' ' ~ ■ ■ ■ : : 

R df ? K 

0.41 1, 382 264.98 .0000001 



TABLE 7 



EducAtion Level X Difficulty Level X Idlosyncmsy Level as the Predictor 
Variable, Conprehension as the Criterion Variable 

df F p< 



0.26 1, 382 130.90 .0000001 



TABLE 8 

Prior Familiarity Level X Difficulty Level X Idloeyncraay Level as the 
Predictor Variable, Coir|>rehen6ioa as the Criterion Variable 

df F K 

0.21 1, 382 98.85 .0000001 



TABLE 9 

Education Levfl X Prior Faniliarity Lavel X Difficulty L«val X tdio- 
ayncrasy Level as the Predictor Variable, Ccnpreheasion as the Criterion 
Variable 



r2 

0.15 



df 
1» 382 



F 

67.95 



.0000001 



TABLE 10 



Education Level X Difficulty Level X Idiosyncrasy Level vs. Prior 
Femlllerity Level X Difficulty Level X Idiosyncrasy Level as Predictor 
Variables, Cootprehension as the Criterion Variable 



4ull 4est. F p 



0.33 0.21 1, 381 67.71 .0000001 



TABLE 11 

A Comparison of the Amount of Variance Accounted for by Three Different 
Linear Regression Models 



Education Level (X^) ■■ ' 
+ 

Prior Familiarity Uvel (Xj) 



Difficulty Level (X3) 
+ 



Idiosyncrasy Level (X^) 
+ 

Xi * Xj 



•R* - 0.6A 



-R' » 0.74 



-r • 0.76 



+ 

+ 



tfhere * stands for multiplication 



AggENDIX A 

(Bxample of Lo Diff Iculty/Lo Zdiosynctdsy Content) 

MflB PICTKR 

A loi« Ua« ago ih«M Uvtd a kind Uttl« Dm 

llttlA girl and bar aothar lived alone in OMaU houee 

near a focratt. 

One day har nothar aiok. Sha mm vaxy iU with 

(5) 

favwp, Sha naadad ao badly. Tha nail and tba tarook 

dry. waa no rain foac a long Una. Tha hoi 



driad up all tha watar* lha littla giael oould 



eat any vaiar. 



Oaa nieht tha Bothav oaUad tha girl, n w vary 

thiraiy. I an afraid that _^ ahall dia. flaaaa gH »a a 

drink of w&tir*" 

" »»111 gH aoiM naiar for you, »othaar»** aaid tha 

(10) 

_ girl. Sha took a oooomit ahall that aha uaad 



« dippar. Tha dippar had a handle. 

Tha little naa aoon on her way to tha well* But 



^^^^ f^und it waa "Ifothar ia vary thiraty. She 



^^^y * ^ tonight. She aoat gat 

_^ »• aad the little girl. 



APPENDIX B 

(Exaaple of Lo Difficulty/Hi Idlosynerafiy Content) 
RIGHT WITH GOD 

Mom thAt w have bMa made right with Cod putting 

our tn»t In Hla, we have peace with . It la beoauae of 

(2) 

what our lord Jesus Christ for us. By putting our trust 

in Godi He given us His loving favor and has rsooivsd 

GO 

us. are happy for the hcipe we have of ahaaping 

shining greatness of God. We are glad for our 



also. We know that troubles help us learn to 

T?5 



give up. When we have learned to not give 

it shows we have stood the test. When we stood ths test. 

it gives us hope. Hope never ^^^^ us aahaaed bscauat the leve 

of God has coae our hearts through the Holy Spirit Who 

(15) 

was given _^ us. 

ror 

were weak and could not help ourselves. Christ 

• — m) 

can* At the right tine and gave Bis , for all iiianers. No 

ons is willing to di# another psrton, but for ii good Ma 

•«i>»oa» night ; : willing to dit. But God aboifed Kis lovo 

to . WhiU we were stiU sinners, Christ diod for 



APPENDIX C 

(Bxanplo of Hi Dlff iculty/Lo Idiosyncrasy Content) 

AHIMilL 

BtcftttM no anlMl poiMSMa the nora fully davaioped fombctain 

laalcaa languaga posalblai the oouunicatl6n aklUa of 



" — ^ — 

«a iunlMl : nth«x^ Halted* In natur*, ulMils haw Muagr 

CO 

Ingtaloua (to ) w»3^ of warning of dangtor or of flizilag 

with aato or of passing on uooful infoxaation. fioos 

glva ___________ to oach othox by danolng* Forpoisoa mm to havo 

____ saall vooabttlary of aoanii^tful nolioa that thoy burbla 



f23 

at .. othor* In oapilvity, aalaals oan taught tm 



.1 parrots are aooustoaed to saying a few words la 



T55 

. and avan old doga ciuk la«M a f aw nan . 

195 (10) 

Ihe young ape oan be taught to out-perfom the infant. 

One ape has been taught to nouthe a __«_________ words, aeeontly» 

(12) 

too* sotte ohlapansees have learned to perfoni ' . 

(13) 

arithnetio exmrolses, using a aaohins conatruoted for this puarpoet* 
' only the loKoet level of what oould be called 



**verbal sklll" oan be lesmed by any ereature bealdaa 



m — 

* Anything «ophi«tloated« such an the liakii^t t««»the» 



APPENDIX D 

(Example o£ Hi Difficulty/Hi Idiosyncrasy Content) 

MBRCISS 



I btM60h you iher«foM, towthren, ty the Mroles of 



that jafoeont your Ijodlea & living sacrlflco, holy, 

(2) 

unto God» Nhlch is your reasonable service* 

And be confomed to this world i but be ye 

^53 

tzaasforaed by renewing of your aind, that ye may jarove 

what that good, and aoeeptable, and perfeo^wlll of God* 
^ I sayi through the grace given unto »e, to 



aan that is aaong you, not to think of ___ 

" (75 

■ore highly than he ought to thinki but to soberly, 

according as God hath dealt to every nan leaaure of 

no5 



faith 



« 



Iter as we have aany neabers one body, and all 

■eabers have not the sane t 

So we, being many, axe one body in Christ, every 

(155 

one Mabers one of another. 



Having then gifts ' aooording to the gnm that 

is given to us, • jrophesy, let us joeopbeMf aceoxdlJtg tc 



